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We study a class of heat engines including Feynman's ratchet, which exhibits a directed motion of 
a particle in nonequilibrium steady states maintained by two heat baths. We measure heat transfer 
from each heat bath separately, and average them using a careful procedure that reveals the nature 
of the heat transfer associated with directed steps of the particle. Remarkably we find that steps are 
associated with nonvanishing heat transfer even in equilibrium, and there is a quantitative relation 
between this "hidden heat transfer" and the directed motion of the particle. This relation is clearly 
understood in terms of the "principle of heat transfer enhancement" , which is expected to apply to 
a large class of highly nonequilibrium systems. 
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To understand universal features of various nonequi- 
librium phenomena in nature is still a widely open prob- 
lem. In spite of considerable interest and efforts (see pj 
and references therein), we are still very far from obtain- 
ing a universal framework even for nonequilibrium steady 
states. We thus believe it desirable to study prototypical 
systems that vividly demonstrate properties which are 
essential to nonequilibrium states. Heat engines includ- 
ing Feynman's ratchet of Fig. [Tfa), which convert 
thermal fluctuations into a directed mechanical motion, 
may be such a prototypical system. These engines have 
also been investigated as Brownian motors Q . Although 
the Curie principle 3 suggests that a spatial asymmetry 
of the system allows a spatially asymmetric motion of the 
particle in nonequilibrium, vivid physical pictures of the 
mechanism of the engines have been missing. The pur- 
pose of the present letter is to develop such a universal 
physical picture. 

As is well-known, Feynman's ratchet consists of a 
wheel and a pawl attached to separate heat baths, and 
exhibits a mechanical rotation [J- Although Feynman 
introduced this model to illustrate the impossibility of 
designing a heat engine with the efficiency exceeding the 
Carnot limit, it has been shown that Feynman's ratchet 
cannot attain the Carnot efficiency [3, |6j . In the present 
study, we focus on a more primitive and hopefully fun- 
damental aspect of the ratchet problem, namely, the di- 
rection of the rotation. Feynman designed the ratchet so 
that the wheel is likely to rotate in one direction. But, 
as Feynman himself pointed out, the wheel can rotate in 
the opposite direction depending on the temperatures of 
the baths (see Fig. ^b)). This fact indicates that the 
direction of the motion is a delicate issue which requires 
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FIG. 1: (a) Schematic figure of Feynman's ratchet composed 
of the sawtooth shaped ratchet wheel and the pawl. The sys- 
tem is attached to two heat baths, the wheel to T x and the 
pawl to T y . The temperature difference between T x and T y 
produces the nonvanishing steady rotation J p , which can be 
used to execute external work. The variable x denotes the 
angle of the wheel. There are degenerate stable positions of x 
corresponding to the ratchet potential wells (there are eight 
in this figure). Heat flows J x and J y are defined as positive 
when the system absorbs energy from each heat bath, (b) 
Typical trajectories of x in NESS. The system exhibits di- 
rected motions, i.e. unidirectional rotations on average. The 
solid lines and the broken lines show the data for the condi- 
tions 2T X = T y and T x = 2T y , respectively, in Model II. We 
clearly see that the direction of the motion depends on the 
temperature difference. 



a careful consideration. 

In the present work, we shall reveal that there is a pre- 
cise statistical quantity that determines the direction of 
the motion. Such an investigation has a practical impor- 
tance in higher dimensional ratchet- like problems, where 
the preferred direction of the motion is far from manifest. 
We shall point out a deep relation between the directed 
motion and "hidden heat transfer" that takes place in the 
equilibrium state. Our main conclusion is summarized in 
the "principle of heat transfer enhancement" . We believe 
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that our findings cover a large class of heat engines, and 
shed new light on universal features of noncquilibrium 
steady states. 

Models: Feynman's ratchet may be realized as dis- 
crete stochastic models [7] or as continuous models de- 
scribed by a set of Langevin equations 5] . We here con- 
centrate on the latter type. The model consists of one 
translational degree of freedom x corresponding to the 
angle of the wheel (in the following we call it the posi- 
tion of a particle) and other degrees of freedom y describ- 
ing the mechanical interaction between the pawl and the 
ratchet wheel. The degrees x and y are in contact with 
heat baths with temperature T x and T y , respectively. By 
suitably choosing T x and T y , we can study the behavior 
of the model in equilibrium or in nonequilibrium steady 
states (NESS). The time evolution of the system is de- 
scribed by the set of Langevin equations, 

m x x = ~-f x x+ \Z2~f x T x £, x (t) - dU(x,y)/dx, 
•m v y = -i v y + x/2jyT y £y(t) - dU(x,y)/dy, 

(1) 

where the x-asymmetric interaction potential U (x, y) has 
a translational invariance in x with period I = 1 |15| . 
Because the potential has stable fixed points in every 
period, equivalent binding states are aligned periodically 
in x. and ^ v are the friction coefficients (here we 
choose j x = 7 y = 1) and £*(£) represent Gaussian white 
noises with a variance of unity. In this letter, we use two 
concrete models to demonstrate the results numerically, 
but the results do not depend on the specific models. 

"Model I" is Sekimoto's version of Feynman's ratchet 
which is the simplest case having only two degrees of 
freedom (x and y). The potential is given by U{x,y) — 
cxp(— y + 4>(x)) + y 2 /2, where (j)(x) is a sawtooth shaped 
periodic function of x 16] . The inertia terms are ne- 
glected (ra x — m y = 0). 

"Model IF has higher degrees of freedom, and was in- 
troduced as a toy model for molecular motors 0, 0, Il0| . 
The particle x and chain sites y = {y{\ are located 
on a one-dimensional circle. The interaction potential 

U(x,y) = J2ii v ( x ~ Vi) + u i{Vi ~ Vi+l) + U 2(Vi ~ is 
composed of three parts, namely, as asymmetric nonlin- 
ear potential v between the particle and the chain site, 
harmonic potential u\ between the neighboring chain 
sites and harmonic on-site potential 112 [HI]. We set 
m x = m y = 1. 

Hidden heat transfer in equilibrium: In shorter time 
scales, the particle (the angle of the wheel) is mostly 
bound to one of the binding states of the potential well, 
and from time to time exhibits sudden jumps (steps) 
to neighboring binding states due to thermal activation. 
The probabilities of rightward and leftward steps must 
be identical in equilibrium, but are in general different 
in NESS. This unbalance generates a directed motion of 
the particle in longer time scales. 

The thermally activated step is an elementary process 
of the system. During a single step (i.e., a jump of the 



particle from a binding state to a neighboring state), the 
system first absorbs some amount of energy (heat) from 
the heat baths and returns it afterward. A close investi- 
gation comparing the heat transfer associated with left- 
ward steps and that with rightward ones will reveal the 
hidden heat transfer in equilibrium. 

In order to examine the heat transfers from respec- 
tive heat baths, let us define the time-dependent heat 
flows J x (t) and J y (t) (energy absorbed into the system 
per unit time) for each trajectory by using the stochastic 
energetics method 0, ^] as 

Jx(t) = [~lxX + \/2j x T x ^ x (t)} o x, 

Jy (t) = [~7» V + y/*1 v T v tvffloy, (2) 

which should be time integrated with the Stratonovich 
interpretation. 

The heat flows J x (t) and J y (t) exhibit large fluctuation 
and hardly allow any physical interpretation as they are. 
In order to detect the heat transfers associated with the 
thermally activated step, we introduce a carefully con- 
ditioned ensemble average as follows. For each step, we 
shift the time variable so that at time t — the particle 
moves from the basin of a binding state to the basin of 
a neighboring state. Then we perform ensemble averag- 
ing of J x (t) and J y (t), separately for rightward steps and 
leftward steps. The averaged quantities are denoted as 
Jf{t), J%(t), J*(i), and J^(t), where J^(t) is the heat 
flow from T x associated with rightward steps, and so on. 

Fig|5Ja)(b) shows these averaged heat flow profiles in 
equilibrium state. The system absorbs energy from the 
heat baths before the step (t < 0), and dissipates it after 
the step (t > 0). The heat flow rapidly converges to zero 
sufficiently after or before the step, and net heat flow 
appears only around the step. 

The heat transfer, i.e., time integrated heat flow, is 
defined as 

f&t'jf{t'), (3) 

J to 

where t < is chosen so that J^(t) is negligible for 
t < t . The quantities Q%(t), Q$(t), and Q^(t) are de- 
fined similarly. Fig]2fc)(d) shows the heat transfer in 
equilibrium state. We here notice the significant fact 
that energy absorbed from one heat bath before the step 
is not returned to the same heat bath after the step. This 
implies that, even in equilibrium, each step carries heat 
from one heat bath to the other. Although the existence 
of such heat transfer may look surprising, it does not con- 
tradict with any of the thermodynamics laws 18]. The 
nonvanishing heat transfer is observed only when we treat 
rightward and leftward steps separately. The word "hid- 
den heat transfer" denotes such heat transfer. Of course, 
when averaged over all steps in both the directions, there 
is no heat transfer in equilibrium. 

In the following, we denote by q cq the hidden heat 
transfer from T x to T y in equilibrium associated with 
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FIG. 2: Time sequences of the averaged heat flow J y (t) over 
conditioned ensembles (3.8 x 10 5 samples) for (a) leftward step 
and (b) rightward step in the equilibrium (T x = T y — 0.05) for 
Model II, where the energy barrier height is about 3.1T X . For 
each step, time is shifted so that the particle crosses basin 
boundaries at t = 0. Heat transfers Q*{t) for (c) leftward 
and (d) rightward steps respectively, which is obtained by the 
integration of J,(t) from to = — 20 (see Eq.(3)). 



rightward steps. Note that we have 

ee Q*(oo) = -<£(oo) = -Q*(oo) - Qj(oo) (4) 

as is seen in Fig|2Ic)(d). The nonvanishing hidden heat 
transfer q cq in equilibrium comes from the asymmetry of 
the interaction potential U(x,y) and the resulting dy- 
namics. Since such an asymmetry is not a special feature 
of the present models but a rather generic one, we ex- 
pect that similar nonvanishing hidden heat transfer in 
equilibrium states is found in a wider class of systems. 

Heat transfer and directed motion in NESS near equi- 
librium: The "hidden heat transfer in equilibrium" ex- 
plored in the above determines the direction of the par- 
ticle motion in NESS as we shall now discuss. Let us 
define the response coefficient %p of the particle flow to 
the temperature difference as 



Xp 



lim J D (3 



A/3/2, 8 + A8/2)/A(3, 



(5) 



where J p (3. 



By) = (x p ) is the particle current for T x = 
l/3 x and T y = l/B y (where A3 = l/T y - 1/T X and 
2/3 = l/Ty + l/T x ). One of course has J p (/3,/3) = 0. 
From the sign of Xpi the direction of the particle flow is 
specified. For example, when \ p > right-oriented flow 
appears for A3 > 0, i.e., T x > T y . 

As shown in FigEl we found a remarkable relation be- 
tween Xp an d the hidden heat transfer g eq , 
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where D° q is the diffusion constant of the particle in equi- 
librium states and I is the period of the interaction po- 
tential in x. The relation © does not only relate the 
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FIG. 3: Hidden heat transfer q cq at equilibrium and lXv/ Dp 1 - 
This reveals that there is a nontrivial relation @ between the 
motion of the particle in a NESS and "hidden heat transfer" 
in equilibrium. Results for the two models, Model I (filled 
square) at /3 = 3 and Model II (open circles) at /3 = 20, are 
shown. For the latter model, the stiffness parameter of the 
model is varied to explore model space broadly so that we 
have many points for the same temperature conditions. 



directions of particle motion and "hidden heat transfer" , 
but shows that these two are related in a quantitative 
manner. In the systems of heat engines, the directed par- 
ticle flow is induced by a "field" associated with temper- 
ature differences. Based on linear response theory |12j . 
the quantity x P , which is the particle flow divided by 
a temperature gradient, is expressed in terms of a time 
correlation function between the particle flow x and the 
heat flow (J x — J y )/2 at equilibrium. Evaluating this 
expression under the assumption that each step occurs 
independently, we can derive Eq. © 13]. 

Eq. (0) implies that a step in the direction of the parti- 
cle flow enhances heat transfer from the hotter to the 
colder heat bath. For example, considering the case 
X P > and T x > T y , the particle flows toward right 
from the definition (JBJ. At the same time, Eq.© implies 
q cq > 0, which means that rightward steps carry heat q eq 
from T x to T y , i.e., from hotter to colder, while leftward 
steps carry the same amount of heat in the opposite di- 
rection. We conclude that the direction of the particle 
motion is chosen so that to enhance the heat transfer 
between the two baths. This "principle of heat transfer 
enhancement" may look quite natural and reasonable. 

Heat transfer and directed motion in NESS far from 
equilibrium: Let us proceed to the observation of heat 
transfer far from equilibrium. Because there is net steady 
heat transfer, we consider the excess heat transfer asso- 
ciated with steps in NESS defined as 



dtlJ^it) - J x }. 



(7) 



to 



The quantities Q^ ox (t), Q^ ex (*) and Qy.cxW are defined 
similarly. Here J^(t) is the conditioned ensemble average 
of the heat flow and the contributions from the steady 
heat flow, J x and J y satisfying J y — —J Xl are subtracted, 
where "bar" means the long time average. Note that we 
have lim t ^ ±00 J^(t) = J x , etc. 
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FIG. 4: Profile of excess heat transfer in NESS of Model II. 
In the upper figures with T y — 2T X , particle flow leftward. In 
the lower figures with 2T y — T x , particle flow rightward. 



Fig. 0| shows the excess heat transfers in NESS. Note 
that, in the figure, the excess heat transfers associated 
with rightward and leftward steps have the same direc- 
tion, namely, from the hotter bath to the colder. How- 
ever, the amounts of heat transfer are different for the 
rightward and leftward steps, and we again find that the 
direction which enhances the net heat transfer is selected. 



We conclude that the "principle of heat transfer enhance- 
ment" holds also in systems far from equilibrium. 

Discussion: We have investigated a class of heat en- 
gines including Feynman's ratchet and found a clear re- 
lation between the directed motion in NESS and hidden 
heat transfer in the equilibrium state. The relation JfJJl, 
which universally holds for the present class, can be de- 
rived from the cross correlation between the fluctuation 
of the heat flow and that of the particle flow. By focusing 
on thermally activated steps, we were able to character- 
ize this correlation in terms of the hidden heat transfer 
q cq . The notion of the hidden heat transfer provides us 
with a vivid picture for the elementary process of the 
heat engine, namely, each directional step carries a heat 
quanta depending on its direction. Heat transfers sepa- 
rately measured for each heat bath would be useful quan- 
tities for the investigation of other systems with multiple 
heat baths. It is also interesting to explore other models 
of heat engine suitable for theoretical treatments 0, E| • 
The fact that the principle of heat transfer enhancement 
holds even in NESS far from equilibrium suggests that 
there can be a universal characterization of NESS. This 
remains as a future problem. We believe that our find- 
ings offer a novel universal view point for studying NESS, 
and will lead to a better understanding of nonequilibrium 
physics in general. 

We are grateful to H. Tasaki for a critical reading of 
this manuscript. 
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